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Abstract 

The flavor changing top quark decays t — > cV (V = Z, 7,5) induced by 
R-parity-violating couplings in the minimal supersymmetric standard model 
(MSSM) are evaluated. We find that the decays t — > cV can be significantly 
enhanced relative to those in the R-parity conserving SUSY model. Our 
results show that the top quark FCNC decay can be as large as Br{t — > eg) ~ 
10 -3 , Br{t — > cZ) ~ 10~ 4 and Br{t — ► 07) ~ 10~ 5 , which may be observable 
at the upgraded Tevatron and/or the LHC. 
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The unexpected large mass of the top quark suggest that it may be more sensitive to new 
physics than other fermions. In the standard model (SM) the flavor changing neutral current 
(FCNC) decays of the top quark, t — > cV, suppressed by GIM, are found to be far below 
the detectable level [1,2]. So, searching for FCNC top decays serves as a powerful probe to 
effects of new physics. The CDF [3,4] and DO [5] collaborations have reported interesting 
bounds on these decays [4]. Undoubtedly more stringent bounds will be obtained in the 
future at the Tevatron upgrade and the LHC. 

Systematic theoretical study of the experimental observability for FCNC top quark de- 
cays at the Tevatron and the LHC has been made in [6,7]. The results show that the 
detection sensitivity can be significant [6,7]: 

Br(t ^cZ)~4x 1(T 3 (6 x 1(T 4 ), (1) 
Br(t -> cry) ~ 4 x 10~ 4 (8 x 1(T 5 ), (2) 
Br(t -4c 5 )-5x 1(T 3 (1 x 10~ 3 ), (3) 

at the upgraded Tevatron of integrated luminosity of 10 (100) fb _1 . The two electroweak 
modes can be improved several fold at the LHC with similar integrated luminosities: 

Br{t ^cZ)~8x 10~ 4 (2 x 10~ 4 ), (4) 
Br{t -4q)-2x 10~ 5 (5 x 10~ 6 ). (5) 

Despite the above interesting experimental possibilities, there is no demonstration in the 
minimal supersymmetric model (MSSM) which is the most favored candidate for physics 
beyond the standard model, that such limits can be realized. In MSSM conserving R-parity, 
the predictions for branching ratios of these FCNC top quark decays were found to be 
significantly below the above detectable levels [8]. In this paper we will show that in the 
case of R-parity violating MSSM [9, 10] with the existing bounds on the R-parity violating 
couplings that violate the baryon number, Br(t — > cV) might reach the detectable level at 
the upgraded Tevatron and the LHC. However, as shown below, the effects of the lepton 
number violating A' couplings in FCNC top decays are negligibly small under the current 
constraints. 

In MSSM the superpotential with R-parity violating is given by [10] 

W$ = \\ 3k L t L 3 El + KjkLiQjDt + \K jk z abd U* a D c jb Dt d + /j, i L i H 2 , (6) 

where L^Qi) and E^Ui, Dj) are the left-handed lepton (quark) doublet and right-handed 
lepton (quark) singlet chiral superfields. i,j, k are generation indices and c denotes charge 
conjugation, a, b and d are the color indices and e abd is the total antisymmetric tensor. 
H\ 2 are the Higgs-doublets chiral superfields. The A^ and \'^ k are lepton-number violating 
il/) couplings, \'-j k baryon-number violating iB) couplings. Constraints on these couplings 
have been obtained from various low energy processes [11-20] and their phenomenologies at 
hadron and lepton colliders have also been investigated recently by a number of authors [19]. 

Although it is theoretically possible to have both B and 1/ interactions, the non- 
observation of proton decay prohibits their simultaneous presence [14]. We, therefore, assume 
the existence of either 1/ couplings or B couplings, and investigate their separate effects in 
top quark decays. 
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FIG. 1. Feynman diagrams for t — > (V = Z,*y,g for quarks and squarks; V = Z, 7 for 
leptons and sleptons) induced by L-violating couplings. The blobs denote L-violating vertex. 



The FCNC decays t — > cV can be induced by either the A' or A" coupling at the one loop 
level. In terms of the four-component Dirac notation, the Lagrangian of the JJ couplings A' 
and couplings A" are given by 



-A' 



-d R d? L + d? L d\vi + (4)* 



-<?A< - u j L d k R e\ - (4)*(el)V L + h.c 



k \* I —i \c j 



2 v k 



d R (u R ) c d R + 4(4) c u R + u R (d R ) c d k R + h.c. 



(7) 
(8) 



where the color indices in Cy are totally antisymmetric as in (6). 



Let us first consider t — > cV induced by 1/ couplings. The relevant Feynman diagrams 
are shown in Fig.l. At one- loop level, they give rise to effective tcV vertices of the form 



V{tcZ) = ie [YP l A z + iKa^PnB 1 
V»(tcj) = ie \ik u a^P R B^} , 
W(tcg) = ig s T a [ik v a^P R B 9 ] , 



(9) 
(10) 

(11) 



where Pr^l = |(1 ± 75) and k is the momentum of the vector boson. The form factors A z , 
B z , etc., are obtained by identifying A z = Af + A z and B v = B\ + B\ , (V = Z,j,g), 
where A 1,9 are found to be zero due to the gauge invariance while others are given by 



Af 



1 



167T 2 

-(v e + a 



KuKsk {(«c + a c )B 1 (M u M e », M- dK 
1 



2c 2 4-- + M^(ci 2 + c 23 ) 



-p t ,p c ,M ei ,M Sk ,M, 



Bf 



^2 



Hv [2c 24 + M 2 (c n - ci 2 + C21 - C23)] (-p t , fc, M e >, M d ~ fc , M Jfc )} 

Y^ A i2fc A i3fe {(^ + a e )M t [cn - C12 + c 2 i - c 23 ] {-Pt,Pc, M ei , M ik ,M e >) 
HvM t [c n - C12 + C21 - c 23 ] (-p t , fc, M e ,, M d -fc, M&)} 
Y^^kKsk {(v c + a c )B 1 (M t , M#,M$) 

-(a d -v d ) 



(12) 
(13) 



2C 24 - - + Mf(c 12 + C2 3 ) 



-Pt,Pc,M d k,M gl ,M d k) 



[ 2C 24 + M t 2 (di - C12 + C 2 1 - C23)] (-Pt, fc, M/< • U • Mgi)} 
Y^2" A i2fc^3fe - ^)Mt [Cn - C12 + C21 - C 23 ] (-pt,Pc, M d k,M^,M d k) 

-i' v M t [c u - cia + C21 - c 23 ] (-p t , fc, M dk ,Mei, Mgi)} . 



(14) 



(15) 



Sum over family indices, i,k — 1, 2, 3, is implied. p< and p c are the momenta of the top 
and the charm quarks. The functions i?i and Cy are 2- and 3-point Feynman integrals 
given in [22], and their functional dependences are indicated in the bracket following them. 
The constant £v(Cv) = ~~ e dS\v/ c w ( — (1 — ^ s w)/^ s w c w) , e d( — l)? 1(0) are for the Z boson, 
photon and gluon, respectively; v/ — (l( — 2ef.sl v )/2swCw and a/ = l(/2swcw are the 
vector and axial- vector couplings with e/ being the electric charge of the fermion / in unit 
of e, and // = ±1/2 the corresponding third components of the weak isospin. The form 
factors B\ 2 and Bf 2 are obtained from Sf 2 by the substitutions, B\ = Bf(a e — > 0, t> e — > e e ), 
5 2 7 = B%(a d ^0,v d ^ e d ), Bf = B?(a e '^ 0, v e -> 0) and Bf = (a d -> 0, v d -> 1); and 
setting M z -> 0. 

Note that the ultraviolet divergencies are contained in Feynman integrals Bi and c 2 4. We 
have checked that all the ultraviolet divergencies cancelled as a result of renormalizability 
of MSSM. 

Similarly, we have calculated the effective tcV vertices induced by the^? couplings shown 
in Fig. 2. The effective vertices have the forms similar to those of Eqs.(9-ll) with the 
substitutions P L <-> P R , A v -> and B v -> F 2 y , where 



+ (v d -a d ) \ - 2c 24 - M£(ci2 + c 23 ) 



*7 



'-puP^M^.M^Mti) 

-tv [2c 24 + M 2 (c n - cia + C2i - c 23 )] (-Pt, fc, Afo , , M d - fc )} (16) 

^ A 2jfc A 3jfc i( V d ~ a d)M t [c u - C12 + c 2 i - c 23 ] {-Pt,Pc, M dj ,M ik ,M d3 ) 
-i v M t [cn - ci 2 + c 2 i - c 23 ] (-Pt, fc, M dJ , M Jfc , M dk )} (17) 

1 "" (18) 



- pZ I 

i r 2 \a.d->0,Vd-^-l,€v^—Zv 



Sum over family indices, j, k = 1,2, 3, is implied. 

Now we present the numerical results for Br(t — > cV). We take M t = 175 GeV, mz = 
91.187 GeV, m w = 80.3 GeV, G F = 1.16639 x l(T 5 (GeV)- 2 , a = 1/128, a s = 0.108, and 
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FIG. 2. Feynman diagrams for t — > cV {V = Z,^f,g for quarks and squarks; V = Z, 7 for 
leptons and sleptons) induced by B-violating couplings. The blobs denote B-violating vertex. 

neglect the masses of charged leptons, down-type quarks, and the charm quark. The decay 
rates increase with the relevant A' or A" couplings and decrease with the increase of the 
sparticle mass. 

We note that there are two mass eigenstates for each flavor squark and slepton, and 
the non-zero off-diagonal terms in the sfermion mass matrix will induce the mass splitting 
between the two mass eigenstates [23]. Since the off-diagonal terms in the mass matrix are 
proportional to the mass of the corresponding fermion [23], the off-diagonal terms in the 
mass matrix of the down-type squark and the slepton are relatively small. For simplicity, we 
assumed all the down-type squark masses to be degenerate, so are the mass of the sleptons. 
As we shall discuss later, these technical assumptions do not affect our results. 

L-violating Couplings: To calculate the bounds of the Brit — > cV) in the presence 

of the 1/ terms, we use the following limits on the 1/ couplings (obtained for the squark 

mass of 100 GeV): |A' Wi | < 0.012 (k,j = 1, 2, 3; z = 2) [16], |A' 13i | < 0.16 (j = 1,2) 

[18], |Ai 33 | < 0.001 [15], |Ay < 0.16 (j = 1,2,3) and \X' 33j \ < 0.26 (j = 1,2,3) 

[19]. There are also the following constraints on the products of the A' couplings [17] [18]: 

Ai3iA' 12l -, \' 23j \' 22j < 1.1 x 10- 3 (i = l,2;j = 1,2,3), \' in2 X' jnl < 10~ 5 (i,j,n = 1,2,3), and 
y y y y y y y y ^ 1 n~ 7 

A 121 A 222? A 122 A 22l5 A 131 A 232> A 132 A 231 ^ ±u • 

Using the upper limits of the relevant 1/ couplings and taking the lower limit of 45 GeV 
for slepton mass, we find the maximum values of the branching fractions to be 

Br{t -> cZ) < 10~ 9 , Brit -> 07) < 10" 10 , Brit -> eg) < 10" 8 . (19) 

If we consider the mass splitting between sleptons, these upper limits on the branching 
fractions still persist. Thus we conclude that the contributions of the 1/ couplings to t — > cV 
are too small to be of interest. 
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B-violating Couplings: For the couplings, A", the bound on top rare decay rates 
can be significantly increased since the A" couplings stand relatively unconstrained, except 
for A'/ 12 and A'/ 13 which have been strongly bounded from the consideration of double nucleon 
decay into two kaons [12] and n — n oscillation [12], respectively. 

Under the assumption that the masses of all down-type squarks are degenerate, Br{t — > 
cV) is proportional to A 2 with A being the product of the relevant 1$ couplings defined by 



a = \" \" i x" X" 4- X" X" 

l\ — ^212^312 ~T A 91?t A 313 T ^993 A3. 



213 /v 313 



v 223 /v 323 



X" X" 

2 A 2jk A 3jk- 



(20) 



While the experimental bounds on A 3 ' jfe have been derived from the ratio of hadron to lepton 
width of the Z°, Ri = T h /Ti [20], we are not aware of any experimental bounds on A^ 
although one can make general estimates from certain low energy data. Therefore, we do 
not have an experimental bound for A. We discuss these points in some detail below. 

First we will argue that it is likely only one term in A, Eq.(20), can be significant. This 
comes from the consideration of the low energy processes, b — > 57 and K° — K° mixing. 
They may provide strong constraints to the products A" 12 A" 13 and A" 13 A" 23 (sum over i is 
implied), respectively [24]. Thus the simultaneous presence of any two terms in A might 
conflict with these low energy processes. However, the existence of only one term, A 212 A 312 , 
A 213 A 313 or A 223 A 323 , will not be constrained by them. 

The bound on X'^ k from Ri = Th/Yi is 1.46 at 2a for down squark mass of 100 GeV [20]. 
We can obtain another constraint from the FNAL data of tt events by examing the exotic 
top quark decay t — > d 3 L + d k R . For the top mass of 175 GeV, we have 



Rt 



Y{t - d{ 



4) 



T(t -> W + b) 



= 1-12 (a; 



3jk 



V175GeV/ 



0(1--% 
m t 



(21) 



The d k R can decay into a dn plus a lightest neutralino (and gluino if kinematically allowed), 
as well as quark pairs induced by the ^ terms. The decay modes, t — > d J L + d k R can enhance 
the total fraction of hadronic decays of the top quark and alter the ratio of tt events expected 
in the dilepton channel. The number of dilepton events expected in the presence of the decay 
t -> d{ + d k R and that in the SM is given by R(f) = (l-/) 2 , where f = Br(t -> d{ + d k R ). The 
CDF measurements of the tt production cross section is cr[tt] exp = 8.3t 3 ; 3 pb in the dilepton 



channel[25], while the SM expectation for top mass of 175 GeV is ct[££]q CD = 5.5±o; 4 pb [26]. 
By requiring R(f) to lie within the measured range of o-[tt\ cxp /a[ti\Qcr>, we can obtain the 
bounds on the relevant A" couplings. The 2a bound from dilepton channel is found to be 



Kjk) 



1 175GeV 



< 0.71. 



(22) 



For M^fc = 100 GeV, we have X'^ jk < 1.25, comparable to the bound from Ri [20]. Constraints 
on A 3jfc from the experimental data of tt in other channels are weaker. 

Although we are not aware of any experimental bound for A 2 j fe , theoretical bounds can 
be derived under specific assumptions [11]. The constraint of perturbative unitarity at the 



SUSY breaking scale M SUSY would bound all the couplings, and in particular 
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FIG. 3. The plot of Br(t — > cV)/(0.2A) 2 as a function of squark mass. 

i.e., X^jk < 3.54. A stronger bound can be obtained if we assume the gauge group unification 
at Mjj = 2 x 10 16 GeV and the Yukawa couplings Y t , Y b and Y T to remain in the perturbative 
domain in the whole range up to M v . They imply Y^jj) < 1 for /i < 2 x 10 16 GeV. Then 
we obtain an upper bound of 1.25 for all X" jk [11]. In this latter case, in case of the presence 
of one term (three terms) in A, A has its maximum value of 1.6 (4.7). But there is no a 
priori reason to take this theoretical assumption. Taking the former scenario of perturbative 
unitarity at the SUSY breaking scale and let, for example, A^ and Ag 12 having their maximal 
allowed values and all the other A'"s to be small, then we have A as large as 5. 

Now we present the numerical results for the effects of A" couplings by considering A as 
a variable and dividing it out from the branching ratios. 

In Fig. 3 we present the plot of Br(t — > cV)/(0.2A) 2 as a function of squark mass. For 
squark mass no greater than 170 GeV we have 

Br{t -> cZ) « (1.2A) 2 x 10" 4 , (23) 
Br{t -> cry) « (0.6A) 2 x 1(T 5 , (24) 
Br(t -> eg) « (0.4A) 2 x 10" 3 . (25) 

We conclude from eqs. (23-25), eqs.(l)-(5) and A to be as large as 5 that the contribution of 
^? couplings to the decay t — > cV might be observable at the upgraded Tevatron and LHC. 

If the decays t — > cV are not observed at the upgraded Tevatron and LHC, we can 
obtain the experimental upper bound for A. We illustrate this in Fig. 4 where we plot 
A versus the degenerate squark mass. The solid, dashed and dotted lines correspond to 
Br(t -> eg) = 1 x 1(T 3 , Br(t -> cZ) = 2 x 10" 4 and Br(t -> cry) = 5 x 1CT 6 , respectively. 
The region above the solid line corresponding to Br(t — > eg) > 1 x 1CT 3 will be excluded if 
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FIG. 4. A versus squark mass for given values of branching ratios. The solid, dashed and dotted 
lines correspond to Br(t — > eg) = 1 x 1CT 3 , Br(t — > cZ) = 2 x 1CT 4 and Br(t — > 07) = 5 x 10~ 6 , 
respectively. 

the decay £ — > eg is not observed at the upgraded Tevatron. The region above the dashed 
and dotted line corresponds to Br(t — > cZ) > 2 x 10~ 4 and _Br(t — > 07) > 5 x 10 -6 which will 
be excluded if corresponding decays are not observed at the LHC. The corresponding value 
of A which sets its upper bound can be read off from the figure. For example, for squark 
mass of 150 GeV, the upgraded Tevatron can probe the A down to 2.3. This bound is not 
very strong but may serve as the first experimental bound on this hitherto experimentally 
unconstrained product of A" couplings. A few remarks are due regarding the above results: 

(a) For the upgraded Tevatron or LHC, the limits on some individual or combinations 
of these couplings may be obtainable from direct squark search. However, we think 
that our results are complementary to the direct search and the processes discussed 
in the present article may involve different combination of the couplings. Since the R- 
violating SUSY contains many parameters, it is desirable to obtain as many constraints 
as possible. 

(b) If the HERA anomalous events [27] were the result of R-parity violating terms [28], 
namely non-zero values for 1/ couplings A', all the^ couplings A" would be very small 
since proton stability imposes a upper bound of 10~ 9 (10~ n ) for any products of A'A" 
in the absence (presence) of squark flavor mixing [14]. Then the effects of any A" 
coupling would of course not be observable. 

(c) As we have pointed out, only one term in A can exist, which is A^Ag^, Af^gA^g or 
^223^323- Let us assume the existence of A^A^ as an example. Besides the two-body 
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rare decays t — > cU, the three-body decays £ — > cdd (exchanging a s) and i — > ess 
(exchanging a rf) can aslo open. Although these decay modes just give rise to three 
light jets and thus are not easy to detect at the upgraded Tevatron or LHC, detailed 
examination for the possibility of detecting these decay modes are needed [24]. 

(d) In the contributions of A" couplings, the masses of down-type squarks d, s and b are 
involved. In our calculation, we assumed the degeneracy of these masses so that we 
extracted a factor A in Eq.(20). However, as we have pointed out, only one term 
in A can exist. Correspondingly, only one flavor of down- type squark is involved. 
So actually our assumption of mass degeneracy between different flavor down-type 
squarks does not affect our numerical results. 

Further, we assumed the mass degeneracy between the two mass eigenstates for each 
flavor down-type squark. Again, let us assume the existence of the term A^A^ as 
an example. Then only strange-squark (s) is involved. There are two mass eigenstates 
for it, namely §i and s 2 . We assumed m Sl = m~ s ^ in our calculation. Theoretically this 
is a good approximation because the mass splitting between s\ and s 2 is proportional 
to the strange-quark mass [23]. We also checked that our numerical results are not 
sensitive to the small mass-splitting. 

Althogh the possible mass-splittings between different flavor squarks cannot signifi- 
cantly enhance the rates of top rare decays, they would cause some unexpected effects 
in low energy processes. For example, the large mass-splitting between charm-squark 
and up-squark, which are not relevant to our calculations in this paper, would lead to 
large FCNC processes in the D-meson system. This will be examined in detail in our 
future work. 

(e) Finally, we should point out that with some couplings as large as 3.5, the model cannot 
be extrapolated beyond a few TeV, which will take away many of the motivations of 
super symmetry. 

In summary, we found that the decays t — > cV can be significantly enhanced relative 
to those in the R-parity conserving SUSY model. In an optimistic scenario that one of the 
products in A of Eq.(20) attend the allowed limit by perturbative unitarity at the SUSY 
breaking scale and by Ri, the branching ratios can be as large as Br(t — > eg) ~ 10~ 3 , 
Br(t — > cZ) ~ 10~ 4 and Br(t — > c~y) ~ 10~ 5 , which are potentially observable at the 
upgraded Tevatron and/or the LHC. If not seen, upper bounds can be set on the specific 
combination of the relevant B" couplings. Together with low energy processes such as b — > sj 
and K° — K° mixing, strong bounds on most of the A" couplings can be set. 
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